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ABSTRACT 

This paper outlines how the Austin Independent School 
District (TeKii) tried to deal with the following questions; (1) 
Should special education students be included in the administration 
of standardized tests?; (2) Should their scores be included or 
excluded in the reporting of test results?; and (3) What are the 
evidences that test scores reflect schools 1 "true" achievement level? 
Previously, the inclusion or the exemption of the special education 
students was determined by hours of service criterion, In the early 
1980s, based tn a comprehensive decision-making process and 
computerized rec 'd keeping system, this responsibility was 
transferred to eajh student's Admission , Review and Dismissal (ARD) 
Committee. The guidelines used by this committee are attached, As 
regards the inclusion of the test scores, all valid scores are 
reported. However, the scores of special education students who were 
tested even though exempted by their ARD Committees, or who took the 
test for experience only, are not reported, Concerning the scores 
representing "true" achievement, test scores obtained by procedures 
which are part of the nerming procedure are not treated as valid. 
Besides the student exemptions policies, copies of participation 
forms for levels K^S and SH12, automatic decisions programmed into 
the computer for various grade levels, special testing procedures, 
and a letter to the itinerant teachers for the visually handicapped 
are attached, (JAZ) 
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SPECIAL EDUCATION STUDENTS; TO BE (TESTED) OR NOT TO BE (TESTED)? 

THAT 1 S A GOOD QUESTION 



Introduction 

The passage of P.L 94-142 In 1975 heralded a drastic change in the 
education of special education students. It mandated the "least 
restrictive" educational environment and Installed the mainstreamlng concept 
in the landscape of American education. Concurrent with these developments 
has been an Increased emphasis on achievement testing (both norm- and 
criterion-referenced) as a measure of evaluation and accountability. 
Achievement test scores have become, rightly or wrongly, the principal gauge 
by which the public judges the effectiveness of schools. Questions which 
arise from these two developments Includes 

1. How should we Include or exclude special education students in the 
administration of standardized achievement tests to uphold both the 
spirit and letter of the law? 

2. How should we include or exclude the scores of special education 
students In the reporting of test results? 

3* How can we be sure that our test scores reflect our schools 1 "true" 
achievement levels? 

These questions, as well as related ones, have received considerable 
attention for several years In the Austin Independent School District 
(AI5D), Austin, Texas. While other districts have struggled with these 
questions, also, only recently has a call come forth for some answers at a 
national-organization level. At a 1985 AERA/NCME convention symposium, 
E. Peckman noted a number of unresolved questions pertaining to standardized 
testing of handicapped students. This paper outlines the answers arrived at 
in Austin to the questions above and to many of the unresolved questions 
noted by Peckman (1985). 

Our Perspective 

It will be useful for the reader to note the context In which Austin's 
answers were formulated, The perspective of the authors is that of 
administrators in the District's testing office who are concerned with fair, 
reliable, and valid measurement of all students' achievement for the purpose 
of districtwide decision making. We are not special education 
administrators. We are not involved In trying to guide special education 
program planning, nor with determining the progress made in special 
education by individual students. Testing for the purpose of program 
placement or exit also falls outside our area of concern, We are regular 
education administrators who, quite simply, have tried to come to grips with 
what Peckman (1985) describes as the "practical implementation issues," 
viz., which special education students should be Included in group tests and 
under what circumstances. We also wanted to foster, in the spirit of 
mainstreamlng, the fullest possible participation by special education 
students in standardized testing activities. This pragmatic approach led us 
to consider and resolve, operationally If not philosophically, a range of 
issues related to standardized testing and special education students, 
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Criteria for Exclusion from Testing 

As the office responsible for districtwide achievement testing, AISD's 
Office of Research and Evaluation (ORE) has played the major role for many 
years in determining which special education students should be included in 
or excluded from test administrations, ORE assumed responsibility for the 
systemwlde testing program In 1975-76 and specific criteria for exempting 
students from districtwide achievement testing were adopted. The policy 
regarding exemption from systemwlde achievement testing has changed several 
times over the years. The exemption policies dealing with special education 
students are detailed in Attachment 1, Basically, two general approaches 
have been taken in the 10 years In which ORE has administered AISD's 
systemwlde testing program s both for an approximately equal number of 
years : (1) exemption based on the number of hours of special education 
services received, and (2) exemption as determined by the judgment of an 
Admission, Review, and Dismissal (ARD) Committee. 

Hours of Service Criterion 

Prior to 1981-82, inclusion In standardized testing was made on the basis of 
the number of hours of special education services received each day. 
Special education students could have been excluded from testing if they 
received one or more hours (grades 1-6) or more than three hours (grades 
7-12) of services per day, The precise reasoning which led to these 
exclusion rules is no longer known, It may be that the one-hour criterion 
was selected for the elementary grades because it effectively excludes all 
elementary special education students from testing, At the secondary level, 
the three-hour standard was probably selected to exclude integrated (now 
called partially self-contained) and self-contained special education 
students. Presumably, these students were regarded t ; difficult to test. 
The reasoning seems to have been that students recelv ng fewer than three 
hours of special education services did not function differently from other, 
regular education students and could therefore be tested, 

ARD Committee Decision 

Beginning in the 1981-82 school year, the testing status of special 
education students has been determined by each student's Admission, Review, 
and Dismissal (ARD) Committee, (As described In Attachment 1, some 
decisions were made by ARD Committees In 1980-81. However, the system was 
not fully Implemented until the 1981-82 school year.) The basic reasoning 
leading to this change was that decisions relating to special education 
students should not be made wholesale by the testing office, but rather, 
both as a matter of logic and of law, should be made individually by the 
deliberative body charged with overseeing the progress of a special 
education student's education, the ARD Committee. 

Implementing the ARD Committee Decision Criterion 

While appealing both for Its sense of rlghtness and Its conceptual 
simplicity, the decision to shift the responsibility for determining which 
special education students were to be included and which excluded from 
standardized testing to the ARD Committees was anything but simple to 
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implement. To accomplish the changeover* a comprehensive decision-making 
and record- keeping system was needed which would satisfy the following 
requirements : 

1, Incorporate all standardized testing in the District; 

2, Permit ARD Committees to make decisions on a test-by-test, and a 
subtest-by-subtest basis; 

3, Make provisions for special testing procedures; and* 

4* Accommodate the District's high school graduation minimum competency 
requirements* 

As a guage of the complexity of the s -tern which was conceived, It can be 
noted that at the time that these changes were contemplated, AISD was 
administering two major achievement test batteries, The Iowa Tests of Basic 
Skills (ITBS) to students In grades K-6 and the Sequential Tests of 
Educational Progress (STEP) to students in grades 9-12, AISD was also 
administering several standardized tests of vocational aptitude and 
preference to secondary students, A locally developed* criterion-referenced 
minimum competency test was being given to high school students, Finally, 
along with all other Texas school districts, AISD had to administer a 
state-mandated, criterion-referenced basic skills test to selected 
elementary grades. 

The main features of the system as It developed Included: 

1- Optical scanning forms— one for grades K-8 and another for 
grades 9-12 (later replaced by a single form), 

2, A permanent computer file, the Special Education Testing (SET) 
file, maintained by ORE, 

3, Special education testing status printouts sent to schools, and 

4, An administrative regulation and guidelines for the ARD Committees, 

Optical scanning sheets . There had to be a mechanism whereby ARD 
Commi i decisions could be communicated to the testing office and to the 
schooi personnel who would carry them out. To this end, ORE developed a 
scannable form to be filled out by the ARD Committees, For the first two 
years, different forms were used for grades K-8 and 9-12, but In 1983-84 the 
forms were combined, Copies of the Initial forms and the current, combined 
sheet are Attachments 2 and 3, 

A host of problems arose in connection with the procedure for completing the 
scanning sheet, many of which had to do with Incorrectly filling out the 
sheet. To address this problem, ORE wrote into the processing programs 
mechanisms for compensating for Incorrect or Incomplete Information, See 
Attachment 4, 
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Perms >e it f 2. ORE created a permanent computer file, the 

Special J * ..1 nn TSET) file, into which the scanning forms were 

read. F th fir , in ears, scanning forms were required annually for 

each spc ^ ,n f jdent, except those who were automatically exempt, 

so the )& w* ' y illy recreated each year. In the last few years, 

scannir . . m e nep.i required only for those students whose testing 

status * change by leir ARD Committees. 

Te: -fc intouts. In the fall and then in the spring before the 
test edn m _ st -at. " s UKt sends a printout to each school listing the 
testif y *titi. f ach special education student on it. In 1981-82, the 
school .d V:a listings themselves, but after meetings with the special 
educatvo r -» ^trative supervisors, it was agreed that all changes in a 
special ec «i\ r^n student's testing status had to be made through the * 
student T ~^RD Committee and communicated to ORE via a specia l e ducation 
scanning s|tetu , " r ~ a ^ " — ~~ — 

Minimum competency . Since the 1975-76 school year, AISD has had a 
minimum competency testing requirement as part of its high school graduation 
requirements. Special education students can graduate without meeting this 
and other requirements for graduation applicable to nonhandi capped students, 
but when possible It Is desirable for a student to graduate under the 
regular education plan. Among their deliberations, ARD Committees had to 
make decisions about how the excluding of students from standardized testing 
would affect their graduation status. Until the state minimum competency 
requirement superseded AISD's procedures. If a special education student 
could be tested validly on any of several tests, and attained a score above 
the cutoff, the minimum competency testing requirement was fulfilled, 

Administrative regulation and guidelines for ARD Committees . To 
forma nze tne new procedures, an administrative regulation was written and 
adopted into district policy. At that time, a document entitled Information 
for ARD Committees to Aid in Determining Participation in Standardized 
lesti nippy special Ed ucation studen ts was proauced, 1 hi s document has been 
revised and reprinted annually since then. Attachment 5 Is section A of the 
latest (August, 1985) edition of these guidelines. 

One feature of section A worthy of scrutiny Is the "factors to consider" by 
an ARD Committee In milking its determination whether a student should be 
tested or not. First, it will be noted that the hours of service criterion 
previously discussed was carried over Into the administrative regulation, 
Second, provision was made for a student who was exempted from testing by an 
ARD Committee to take the test for the experience of taking a standardized 
test. As originally conceived, this alternative was made available in 
response to teachers 1 concerns about students feeling set apart and excluded 
from an activity in which all the other students were participating. It was 
anticipated that very few students would be tested "for experience only* 11 
In this expectation, testing staff were greatly mistaken. Experience-only 
testing was to prove a major headache for testing staff, special education 
staff, and nearly everyone else Involved with the testing. 
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Experience-Only Testing 

Reporting . At the outset , experience-only test scores were withheld front' 
the campuses. The reasoning was that since the ARD Committee had determined 
that the student could not make a valid score on a standardized test, and 
that the student had taken the test solely for the test-taking experience, 
the student's score was invalid a priori and of questionable validity In any 
event. Under pressure from school staff and special education staff for the 
scores, this position soon gave way, ORE began reporting experience-only 
scores only to the special education supervisors/coordinators for the purpose 
of making decisions about the students 1 testing status for the next year. 
Coordinators were requested to use their professional judgment in deciding 
whether to share the scores with other school personnel, the students, or the 
students parents. To allay the continued demand for experience-only scores, 
for the past few years ORE has produced a slnqle, letter-sized report of each 
special education student's scores, both valid and experience only, to be 
placed in the student's special education folder on campus, 

Misconceptions , The most persistent problems with experience-only 
testing came about because of misconceptions about what "experience only" 
meant. To the testing staff in ORE, experience-only testing was intended to 
be a minor subcategory of exemption, to be employed infrequently. However, 
campus personnel, and sometimes special education staff, confused the 
experience-only testing status with the criteria for excluding special 
education students' test scores from the school wide averages. The category 
came to be regarded as a means for schools to protect themselves from the 
test scores of special education students, which they feared would be 
averaged in with their other test scores and "drag them down," In fact, the 
criteria for excluding special education students' test scores (to be 
discussed in the next section) had nothing to do with the experience-only 
status of the scores. This was communicated to campuses and special 
education staff Innumerable times, but the misconception persisted, In 
consequence, special education staff reported that pressure was sometimes 
brought to bear on ARD Committees to determine that special education 
students should be tested for experience only rather than for valid scores* 
As a result, a sort of "ghost testing" emerged In which a substantial number 
of special education students were tested for experience only when they could 
have been tested for valid scores. More will be said about this point later. 

Minimum competency . The experience-only category led to some problems 
with the minimum competency status of special education students, Special 
education students could be exempted from the minimum competency testing 
requirement for high school graduation. In a few cases, exempted students 
took and passed a minimum competency test, whereupon schools requested, even 
demanded, that the student's exempt status be altered post facto. Rather 
than penalize the student, ORE made the change, but ditTso with the uneasy 
recognition that changing the student's status after the fact did violence to 
the whole system of having the ARD Committees decide student testing status 
and may, In fact, have be en Illegal, However, confusion over the proper 
completion of the scanning form cast, doubt about whether some students were 
ever Intended to be exempt. 
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Drawbacks to the System 

The new procedure, while allowing for the maximum possible flexibility in 
deciding special education students 1 testing status* vastly complicated 
QRE^s record keeping, For their part, ARD Committees had to add the 
decision making to their already lengthy deliberations. Both of these 
allocations of resources seem to be worthwhile In view of the outcomes s 
however, 

Some problems with the system remain troublesome, One of the most basic is 
that* although the attempt was made to Incorporate all standardized testing* 
the system has never become fully functional for the standardized 
Instruments other than achievement tests, The data were maintained on the 
SET file, but only token attempts were made to encourage other offices to 
participate in the decision making and to access the data. In truth* the 
system works best for the norm-referenced* achievement tests whose 
administration Is coordinated by ORE* The TABS (Texas Assessment of Basic 
Skills)* the state-mandated* criterion-referenced basic skills test* sticks 
out as an exception to many statements in the guidelines for ARD 
Committees, Although ORE has taken great pains to accommodate the 
exceptions in the guidelines* the TABS* now the TEAMS (Texas Educational 
Assessment of Minimum Skills) * has done conceptual violence to the system, 

Another continuing problem* as discussed earlier* is the persistent 
confusion about the experience-only decision category, As will be discussed 
later* there has been some progress toward the original conception of the 
category* but there Is still room for Improvement, 

AffD Committee Decision vs, Hours of Service Criterion 

In spite of these problems* the changeover from the hours of service 
criterion to having the ARD Committees determine special education students 1 
testing status was ^ positive step toward broadening the participation of 
special education students in standardized testing, Figures 1 and 2 show 
the testing status of students for 1984-85 based upon these two methods* ARD 
Committee decision versus hours of services received per day, 

o More students were scheduled to be tested in 1984-85 at grades 1-12 
by the ARD Committees than might have been tested If numbers of 
service hours determined testing status, 

o Fewer students were exempted from testing by the ARD Committees 

than might have been exempted if number of service hours determined 
testing status. 

Figures 3 and 4 provide the number and percent of special education students 
scheduled to be tested or exempted from testing, as determined by ARD 
Committees* in 1984-85 compared with the same information for the two 
previous years, 

(Text continues on page 11*) 
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Figure 1 



1984-85 TESTING STATUS OF SPECIAL EDUCATION STUDENTS AS DETERMINED 
BY THE, ARB COMMITTEES, SHOWN BY HOURS OF SERVICE 
(NUMSl AND PERCENT OF STUDENTS) 
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Figure 2 



NUMBER AND PERCENT OF SPECIAL EDUCATION STUDENTS 
TO BE TESTED OR EXEMPTED FROM TESTING FOR 1984-85, 
ARD COMMITTEE DECISION VS. HOURS OF SERVICE CRITERION 



Students To Be Tested Students Exempted 

Grades 1-6 XV^, E, or Combination) From Testing 

Testing Status Determined 
by Number of Hours (>1) 0(0%) 2646 (100,0%) 

Testing Status Determined 

by ARD Committee 1993 (75,3%) 653 ( 24.7%) 

Grades 7-8 

Testing Status Determined 
by Number of Hours (>3) 581 (61.6%) 362 ( 38.4%) 

Testing Status Determined 

by ARD Committee 746 (79.1%) 197 ( 20.9%) 

Grades 9-12 

Testing Status Determined 
by Number of Hours (>3) 715 (57.6%) 525 ( 42.3%) 

Testing Status Determined 
by ARD Committee 781 (63.0%) 459 ( 37.0%) 
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Figure 3 



NUMBER AND PERCENT OF SPECIAL EDUCATION STUDENTS TO 
BE TESTED OR EXEMPTED FROM TESTING, GRADES 1-6 
AND 7-8. 1982-83 THROUGH 1984-85 



ARD Committee Students to be 

Testing Status i Grades 1-6 Tested or Exempted 

1982-83 1983-84 1984-85 

All Tests Valid (V) 30.0% ( 959} 35,7% (1089) 39.8% (1053) 

All Tests Experience Only (E) 10.0% (. 321) 7.7% ( 234) 5.9% ( 156) 

All Tests Exempt (A) 28.9% ( 924) 26.5% ( 808) 24.6% ( 653) 

Combination (V, E, and A) 31.1% (. 997) 30.0% ( 9.15) 29.7% ( 784) 

TOTAL 100.0% (3201) 99.9% (3046) 100.0% (2646) 

(100.0%) (100.0%) (100.0%) 

ARD Committee Students to be 

Testing Status ; Grades 7-8 Tested or Exempted 

1982-83 1983-84 1984-85 

All Tests Valid (V) 50.2% ( 550) 54.8% ( 573) 62.4% ( 588) 

All Tests Experience Only (E) 8.9% ( 98) 11.2% ( 117) 10.1% ( 95) 

All Tests Exempt (A) 30.8% ( 337) 27.2% ( 284) 20.8% ( 197) 

Combination (V, E, and A) 10.0% ( 110) 6.9% ( 72) 6.7% ( 63) 

TOTAL 100.0% (.1095) 100. 1%( 1046)100.0% ( 943) 

(100.0%), (100.0%) (100.0%) 



11 



85.38 



Figure 4 



NUMBER AND PERCENT OF SPECIAL EDUCATION STUDENTS TO BE 
TESTED OR EXEMPTED FROM TESTING, GRADES 9-12, 
19d2-83 THROUGH 1984-85 



ARD Committee 

Testing Status ; Grades 9-12 



All Tests Valid (V) 
All Tests Experience Only (A) 
All Tests Exempt (£) 
Combination (V, E, and a) 



1982-83 
46.9% ( 782) 

5.1% ( 85) 
43.3% ( 722) 
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(100%) 
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Tested or Exempted 

1983-84 
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42.4% ( 656) 

3.9% ( 61) 



99.9% (1545) 
(100%) 



1984-85 
55.0% ( 682) 

5.0% ( 62) 
37.0% ( 459) 

3.0% ( 37) 



100.0% (1240) 
(100%) 
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It may be seen from the figures that! 

o A greater percentage of students was scheduled to be tested for 
valid scores In 1984-85 than was scheduled In either 1983=84 or 
1982-83, 

o A smaller percentage of students In grades 1-6 was to be tested 
for experience only in 1984-85 than in 1983-84 or 1982-83. 

o In grades 7-8, a smaller percentage of students was to be tested for 
experience only in 1984-85 than in 1983-84. However, the 
percentages of students to be tested for experience only In 1984-85 
and 1983-84 both exceeded the percentage to be tasted for experience 
only In 1982-83, 

o In grades 9-12, approximately the same percentages of students were 
to be tested for experience only in each of the three years reported. 

o Smaller percentages of students were to be exempted from testing or 
to be tested on selected tests in 1984-8 r than in the previous two 
years. 

Overall, the data in Figures 3 and 4 suggest a trend in the direction of ARD 
Committees deciding that more special education students should be tested 
for valid scores. Whether this apparent intent on the part of ARD 
Committees is being realized is addressed in the next section. 

Match Between ARD Committee Decision and Actual Involvement 

The ARD Committees determined the testing status for each special education 
student for each subtest. The extent to which the ARD Committee decisions 
for 1984-85 were carried out by the schools is shown in Figures 5 and 6. 

o The ARD Committees designated that more tests in grades 9-12 
should be taken for a valid score than not taken (exempt). 
This did* in fact, occur in practice* 

o Numerous tests were not taken when they should have been taken 
for a valid score or for experience only. Likewise, numerous 
tests were taken that should not have been. 

Figure 7 shows the numL * and percent of the departures from ARD 
Committees 1 decisions ir. 1984-85, compared to the two previous school 
years. 

o The percentage of tests to be taken for a valid score that were 
not taken declined in grades 1-12; however, the percentage of 
tests to be taken for experience only that were not taken 
Increased sharply, In grades 9-12. The percentage of tests 
that were not to have been taken and were taken also increased 
both at grades 1-6 and 7-8, but decreased at grades 9-12. 

(Text continues on page 15.) 
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figure 5 



TEST DECISIONS MADE BY THE ARD COMMITTEES COMPARED TO THE TESTS 
ACTUALLY TAKEN BY SPECIAL EDUCATION STUDENTS IN 1984-85 
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Number and percent are based on the total number of tests possible for all special education 
students in each of the grade ranges shown. 
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Figure 6 



NUMBER AND PERCENT OF TESTS TAKEN BY SPECIAL EDUCATION STUDENTS IN 
1984-85 HOT FOLLOWING ARD COMMITTEE DECISIONS 



Official 
(ARD) 

Testing Taken for 

Status Experience Only Not Taken Total 

Valid 957 ( 6.7%) 14366 Grades 

Experience Only 404 (15,9%) 2534 1-6 

Exempt 906 (11.6%) 7804 

Valid 568 ( 8.4%) 6785 Grades 

Experience Only 262 (19,3%) 1358 7-8 

Exempt 246 ( 9.6%) 2553 

Valid 835 (23.0%) 3625 Grades 

Experience Only 245 (60,8%) 403 9-12 

Exempt 22 1 (7,6%) 2898 

Percentages are of totals within a given category, e.g., valid. 



Total Number and Percent of Tests Not Following ARD Decision 

)er Percent Total Number of Tests* 



Grades 1-6: 2267 9.2% 24,704 tests 

Grades 7 and 8: 1076 10.1% 10,69b tests 

Grades 9-12: 1301 18.8% 6,926 tests 

Grades 1-12.* 4644 11.0% 42,326 tests 

* Total number of tests about which ARD Committees made decisions in each 
of the grade ranges shown, 
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■ H * TOTAL NUHHER OF TESTS. This is the actual numbar of Casts to be taken, This includes tests taken by special 
education students in accordance with ARD Comnittee decisions, 
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o Overall, in grades 1-8 there was a closer match between ARD 
Committee decisions on the testing status of special education 
students and their actual involvement in standardized testing 
in 1984-85 than In the previous two years, 

o In grades 9-12, the match between ARD Committee decisions on 
the testing status of special education students and their 
actual Involvement in standardized testing was about the same 
in 1984-85 as In 1983-84. 

o Over the past three school years ? both the number and percent 
of the tests not following ARD Committee decisions have 
decl ined. 

Notwithstanding this positive trend, there still seems to be a tendency 
to test some special education students for experience only who *~ 
probably should be tested for valid scores" Special education students 
score in the entire range of percentile ranks, The percent and number 
of tests taken for a valid score or for experience only yielding scores 
in various percentile ranks are shown in Figure 8, 

o Some special education students scored at the highest 

percentile ranks on casts that were taken for experience only, 

o Special education students score below the 30th percentile in 
the majority of tests taken for either a valid score or 
experience only, 

Criteria for Exclusion of Scores In Reported Test Results 

Individual Students' Scores 

AISp schools receive from ORE several types of test reports, providing both 
Individual and school and district summary results* In reports of 
Individual results, such as alphabetic and rank-order listings, al 1 val id 
student scores are reported , including those of special education students, 
The scores of special education students who were tested even though 
exempted by their ARD Committees, or who took the test for experience only, 
are not reported to schools. The students 1 names are printed, but an "E," 
noted as "EXPERIENCE ONLY, SCORE SENT TO SPECIAL ED," is printed where a 
score would usually appear. This procedure is followed so that school 
personnel and others will know that a given student was in fact tested and 
that the scores are available elsewhere (in special education students' 
folders, with the special education coordinators, and in ORE), In sum, only 
valid scores are printed on regular reports. Experience-only scores are 
reported in more restricted formats to guard against their possible misuse* 

School and District Summary Resu lts 

Beginning in 1981-82, students 1 scores were excluded from school and 
district summary reports under the conditions shown in Attachment 6. Before 
1981-82, as previously discussed, the students themselves were exempted from 
testing based on the number of hours of special education services, 

(Text continues on page 19. ) 
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Special education students 1 scores are excluded as follows: 

Grades K-6 Scores for special education students, who 

received one or more hours of special 
education services per day, or who took 
the test even though exempted by their 
ARD Committee, or who took the test for 
experience on! y* 

Grades 7-12 Scores for special education students who 

received more than three hours of special 
education services per day, or who took 
the test even though exempted by their 
ARD Committee, or who took the test for 
experience only* 

In short, other than the addition of experience-only scores to the 
exclusionary rules, special education students 1 test scores are 
excluded from summary reports ac cordTmpto the same criteria by which 
students themsel ves^used to be exc ! uded from testing . Several factors 
account for this, The first is a disinclination by ORE to report 
longitudinal results for which different exclusion rules were used in 
different years* Previous years 1 results could be recalculated 
according to new rules, but the size of the task mitigates against 
embarking on this course casually, A second reason that students 1 
scores are excluded from summmary reports even through they are no 
longer systematically exempted is the apprehension on the part of 
campus-level personnel that the scores of their special education 
students will adversely (and differentially) affect their summary 
results, ORE staff have entertained the notion that all valid scores 
should be Included in school and district summary reports--a proposal 
which seems to be favorably regarded by special education administra- 
tive staff«but informal discussions with school personnel have not 
given the idea particular encouragement. 

Recalculating Junior High School Distrlctwide Medians 

Secondary and elementary special education students are excluded from 
distrlctwide ITBS calculations according to different criteria, 
Secondary students are excluded from distrlctwide scores if they 
receive more than three hours of special education services per day; 
elementary students are excluded if they receive one or more hours of 
special education services. As with the criteria for exclusion of 
students from testing, the reasoning for this difference is no longer 
known. Consideration of a single criterion brings up the same sort of 
difficulties as with new exclusion rules. CI early, however, the 
different criteria influence the reported results* Figure 9 presents 
1984-85 junior high median percentile scores for each of the skills 
area totals and for the composite test calculated with special 
education students excluded according to the usual junior high 
criterion and according to the elementary criterion. As shown in the 
figure, the recalculated junior high school scores are all higher than 
those normally reported. 
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Figure 9. 1983=84 JUNIOR HIGH DISTRICTWIDE ITBS MEDIAN PERCENTILE 

SCORES, CALCULATED WITH SPECIAL EDUCATION STUDENTS EXCLUDED 
ACCORDING TO TWO DIFFERENT CRITERIA, 



Knowing Whether Your Scores Represent "True" Achievement 

When the initial decision was made to shift to the ARD Committees the 
responsibility of making decisions about which special education students 
should take which standardized tests, ORE developed some guidelines 
governing special testing procedures (see Attachment 7). As described in 
Attachment 7, for ORE special testing procedures fall Into two categories, 
those which may Invalidate the use of test norms and those which do not, 
For tests which do not have norms, this Is not a concern, It was decided 
that test scores obtained by procedures which were not part of the norming 
procedure, such as extended testing time, could not be treated as valid. 
See Attachment 8 for a more complete discussion of this point. Here the 
following points can be made: 

1- Implied In these special testing procedures, and In AISD's 

whole approach to the standardized testing of special education 
students. Is the assumption that the ARD Committees can make 
valid judgments about whether special education students can 
take tests for valid scores, and 

2. That If the special education students for whom ARD Committees have 
made this determination take the test under the same conditions as 
were applied to the norming group, the resulting sc ores ar e valid 
measurements of achievement, "~" 

In other words, achievement test scores obtained by special education 
students under certain special administrations (those which do not 
invalidate the test norms) are regarded as valid and comparable with scores 
obtained under standard administrations, 
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As a procedural footnote, it may be observed that test scores obtained by 
special education students under procedures which may invalidate the test 
norms are not "flagged," as is the practice of ETS and the College Entrance 
Examination Board, Rather, these scores are forced into the experience-only 
category and are, therefore, reported separately under the strictures 
described in the previous section, 

ORE's Interpretation of what constitutes valid test scores is not 
unanimously accepted even in AISD, While ORE holds that the scores of 
special education students tested under the same conditions as those applied 
to the normlng group are representative of the students 1 true achievement 
levels* some special educational personnel in AISD do not agree or accept 
that definition. They interpret a student's true achievement level as 
"what a special education student would score on „.e test If the 
handicapping condition were removed," While not accepted by ORE, this 
interpretation Is a potential problem when ARD committees designate tests to 
be taken "for experience only," 

Ultimately! of course, classical testing theory holds that we can never know 
precisely what our "true" achievement levels are. However 5 employing the 
procedures described s it does not seem unreasonable to regard the test 
scores obtained by AISD special education students to be as valid as the 
test scores attained by regular education students. 

Conclusions 

Although there are many nuts-and-bolts details which need to be ironed out, 
the participation of special education students in standardized testing can 
be increased by having ARD Committees determine the standardized testing 
activities in which special education students may participate. Resources 
have to be allocated to set up a system to effectuate the necessary 
decision-making and record-keeping tasks. Care should be taken at the 
outset to avoid setting up a system which permits nebulous and dysfunctional 
categories— e.g, f "experience only"— to evolve. Local and state minimum 
competency testing requirements for high school graduation must also be 
carefully Incorporated in any systemwide changes. 

Achievement testing is an important practice In public schools* The 
involvement of special education students, and the manner in which their 
achievement test scores are handled, must be given thorough consideration by 
educators and made Into consistent policy. Given the national concern and 
call for policy statements regarding the testing of special education 
students, Austin ISO's experiences in formulating special education 
achievement testing policies should provide educators with useful and timely 
information. 
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Attachment 1 
(Page 1 of 2) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 
Austin, Texas 



Student Exemptions from Achievement Testing 

A. High School Exemption Policies 

o During the 1975-76 through 1977-78 school years, the 

following categories of students were exempted from STEP 
testing. 

Any student who was enrolled In an Integrated (self- 
contained) special education classroom was exempt from 
STEP testing, 

o Beginning in 1980-81 and continuing through 1984-85, 

special education students were exempted from STEP testing 
(1980-81 to 1982-83) and TAP (1983-84 to 1984-85) by their 
local Admission, Review, and Dismissal (ARD) Committee, 

B. Junior High School Exemption Policies 

o During the 1975-76 and 1976 7 school years, special 

education students who spent two class periods or more of 
each school day In the resource room* or who were enrolled 
in integrated or self-contained special education classes, 
were exempted from CAT testing, 

o In 1977-78, students who were enrolled in integrated or 
self-contained special education classrooms were exempted 
from CAT testing, as before. Students who spent part of 
the day In the special education resource room were tested 
at the discretion of the special education teacher, Scores 
for those students were not included in the school summary 
reports, 

o During the 1978-79 and 1979-80 school years 5 only students 
who were enrolled In Integrated or self-contained special 
education classes were exempted from the testing. Resource 
room students were required to take the test, and their 
scores were Included in the school summaries. 
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Attachment i 
(Page 2 of 2) 



o Beginning with the 1980-81 school year, special education 
students were exempted from ITBS testing by the local 
Admission, Review, and Dismissal (ARD) Committee* Students 
whose ARD Committees had not yet made a determination 
regarding their inclusion in or exclusion from testing for 
1980-81 could be exempted at the discretion of the 
principal , 

C- Elementary School Exemption Policies (Spring, Grades K-6) 

o The exemption policy for special education students 
remained unchanged from 1975-76 to 1979-80, 

Special education students who spent one hour or more per 

day in the .resource room, or who were enrolled in an 
Integrated or self-contained classroom, were exempted from 
CAT (1975-76 to 1978-79) or ITBS (1979-80) testing. 

o Beginning with the 1980-81 school year, special education 
students were exempted from ITBS testing by the local 
Admission, Review, and Dismissal (ARD) Committee, Students 
whose ARD Committees had not yet made a determination 
regarding their Inclusion in or exclusion from testing for 
1980-81 could be exempted at the discretion of the 
principal . 

D, Kindergarten Exemption Policies (Fall, ITBS Level 5 Language Test) 

o In the 1981-82 school year, special education students were 
exempted from taking the ITBS Level 5 Language Test by the 
local ARD Committee* Students whose ARD Committees had not 
yet made a determination regarding their inclusion in or 
exclusion from testing for 1981-82 could be exempted at the 
discretion of the principal, 

o Beginning with the 1982-83 school year, special education 
students were exempted from taking the ITBS Level 5 
Language Test only through their ARD Committees, 



CAT m California Achievement Tests 
ITBS = Iowa Tests of Basic Skills 
STEP - Sequential Tests of Educational Progress 

TAP = Tests of Achievement and Proficiency 
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PUNCTUATION ! 

M-MATH 
S-SCIENGE 
SS-SOCIAL STUDIES 
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NAME(S] OF TIST(S) HIRE: 
A , 

B . " 
0, 
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SPECIAL TESTING 
PROCEDURES 
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IF "OTHER" PROCEDURE REQUIRED, 
DISCRllI HIRE: 
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READ TEST QMARK ANSWERSQ 
EXTEND TIME 0 INDIV ADMIN 0 
OTHER 0 REVISE SCKED.0 
SIGNINGQ 
SMALL GROUPQ 

OTHERQ 



grades 8 -12 only: 
ifacatigoryaprogeduriis 

NEEDED AND THE SCORE IS I OBt 
COUNTED TOWARD MEETING MINI- 
MUM COMPETENCY, FILL OUT A 
REQUEST FOR SUPERINTENDENT'S 
APPROVAL, 
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85.38 BACK ... . ... , 

Attachment 3 

Fill out a scantier siwot only for students new to AISD , or to change (Page 2 of 2) 
information curreiUl¥_on H'e for a student. 

HO W TO COMPLETE THIS FORM 
° Complete each of the following areas on this scanning sheet: 
STUDENT INFORMATION 



* Student Name {FULL NAME including middle Initial) 

* Student Number 

° Cununt Grade (grade at time of ARD) 

* Current School (school enrolled In at time of ARD) 

* ARD Meeting Date (month and year) 

SPECIAL TESTING PROCEDURES 

* Complete areas as they apply. If a Category M A" 
procedure i s needed for a test, the test must be 
taken for experience only. 



S i ANDARDIZIO TESTS 



Complete areas as they apply, for the grade in which 
the next testing will occur. 

* If student is exempt from the test, make no marks, 

° Mark @ if student should take the test for a valid score, 

* Mark (T) if student should take the test for experience only, 

Grades 9-12 only: Information Indicated for the TAP or 
TALJS/ TEAMS also determines the student's status for 
minimum competency testing, 



TEST CODES 

|TBS:LA- LANGUAGE TABS/TEAMS: R-READiNG 

M MA VHEMAl ICS JJ- MATH 

V- VOCABULARY W^WRITING 
REREADING COMPREHENSION 
WA-WORD ANALYSIS 

SP-SPELLING i TAP; R-READING COM PREHENSION 

CA-CAPJTAl I2ATION ' LANGUAGE M-MATHEMATICS 

PN PUNCTUATION i SKILLS WE-WRITTEN EXPRESSION 

US- USAGE ' US-USING SOURCES OF INFORMATION 

VM-VISUAL MATERIALS | WORK-STUDY SS SOCIAL STUDIES 

RM-RIFIRENGE MATERIALS \ SKILLS S-SCIENCE 

CN^CONCEPTS i 

PR-PROBLEMS MATH J/K: I-IDEAS 

CM-COMPUTATION J SKILLS K-KUDER 



NOTES ON MARKING THIS FOR M COR RECTLY 

* Use a Number 2 pencil only. 

* Mark dark marks which fill the oval. Light, single lines are 
fioi sufficient marking. 

» Erase completely all unwanted marks, 

* Do not make holes in this sheet, 

* Do ngi mark the ovals containing an "E" to indicate exempt, 
"E" means test the student for EXPERIENCE ONLY, If the 
student should be EXEMPT , do not markjanyjpyals, 

* Do not fold or crease this sheet. 
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Attachment 4 
(Page 1 of 2) 

AUSTIN INDEPENDENT SCHOOL DISTRICT 

Office of Researc: and Evaluation 



AUTOMATIC DECISIONS PROGRAMMED INTO THE COMPUTER 

To ensure that the most complete information for each student is recorded, 
some decisions have been made that the computer has been programmed to carry 
out automatically. 



SHORT SUMMARIES 

Category A - Experience 
only tests 



FOR GRADES K-12 

• In Section II, if the student is marked to 
be tested under one or more of the special 
testing procedures In Category A, all of 
the student's tests except TEAMS will be 
considered for experience only, 

FOR GRADES 1,3, 5, and 7 



Valid ITBS - 
Valid TEAMS 



Blank test level = 
test down one level 
(grades 4-6 only) 



No out-of-level testing 
except grades 4-6 



. In Section III, if the student is marked 
• for a valid (V) test on one or both of the 
ITBS reading tests* Vocabulary or Reading 
Comprehension (abbreviated V and R) , and 
TEAMS Reading (R) has been left blank, 
iEAMS Reading will be considered valid, 

. If the student is marked for a valid test 
on one or more of the ITBS mathematics 
tests, Concepts, Problem Solving, or 
Computation (CN S PR, and CM), and TEAMS 
Mathematics (M) has been left blank, TEAMS 
Mathematics will be considered valid, 

- If the student is marked for a valid test 
on one or more of the ITBS language tests. 
Spelling, Capitalization, Punctuation, or 
Usage (SP S CA, PN, and US), and TEAMS 
Writing (W) has been left blank, TEAMS 
Writing will be considered valid* 

FOR GRADES 4-6 

, If no oval Is marked in the box labeled 
"ITBS TEST LEVEL," the student will be 
assigned the test level one level down 
from that which would be given to a 
student in the same grade tested on-level . 

, If the student's grade is not 4, 5, or 6, 
and an oval Is marked in tHF^box labeled 
11 ITBS TEST LEVEL," it will be treated as 
if It were blank. 



New/updated information 

ERLC 
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(continued on next page) 
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Valid TAP - Valid TEAMS 



Valid TAP or TEAMS = Valid 
for mininiuni competency 1 
testino (orade 12 in 
1985-86 only) 



Exempt or Experience only 
TAP and Exempt TEAMS = Exempt 
from minimum competency 
testing (grade 12 in 1985- 
86 only) 



Experience only TEAMS = 
Exempt TEAMS 



FOR GRADES 9-12 



Attachment 4 
(Page 2 of 2) 



, In Section III, if the student is marked 
for a valid (V) test on TAP Reading 
Comprehension (R), and TEAMS Reading (R) 
has been left blank, TEAMS Reading will be 
considered valid. 

If the student is marked for a valid test 
on TAP Mathematics (M), and TEAMS 
Mathematics (M) has been left blank, TEAMS 
Mathematics will be considered valid. 

If the student is marked for a valid test 
on TAP Written Expression (WE), and TEAMS 
Writing (W) has been left blank, TABS 
Writing will be considered valid. 

If the student is marked for a valid test 
on TAP Reading Comprehension (R) or TEAMS 
Reading (R), the student will be 
considered as valid for minimum competency 
testing in reading. 

If the student is marked for a valid test 
on TAP Mathematics (M) or TEAMS 
Mathematics (M) , the student will be 
considered as valid for minimum competency 
testing in mathematics. 

In Section III, if the student is marked 
to be tested for experience only (E) or is 
exempt from testing on TAP Reading Compre- 
hension (R) and is exempt from testing on 
TEAMS Reading (R), the student 
considered exempt from minimum 
testing in reading* 



will be 

competency 



. If the student is marked to be tested for 
experience only (E) or is exempt from 
testing on TAP Mathematics (M) and is 
exempt from testing on TEAMS Mathematics 
(M), the student will be considered exempt 
from minimum competency testing in 
mathematics - 

FOR GRADES 1,3, 5, 7 ,9 AND 11-12 

. In Section III, if the student is marked 
for experience only on a TEAMS test, the 
student will be considered exempt from 
that test, (Only the older versions of 
the scanning sheet can be marked TEAMS For 
Experience Only, This promdure will be 
applied if an old scar ng rh et is 
returned to ORE). 



38 



*w* = New/updated information 

ERIC 



29 



85.38 



Attachment 5 



Adminis tra live 
Regula tion 



REGULATION AND PROCEDURES 

Administrative regulation EKC-R contains the District 1 : 
procedures governing inclusion of special education 
students in standardized testing. As stated in the 
regulation, the ARD Committee will determine in which 
standardized testing activities a special education 
student should or should not participate. This is 
consistent with the rules adopted by the State Board 
of Education 1n February, 1985 regarding exemption 
from State assessment of minimum skil is {section 101.3 
of Chapter 101 , Texas Administrative Code), As stated 
in the regulation, the ARD Committee should consider 
the following factors in making its determination, 



Factors to Consider 



THIS IS THE DEFINITION 
OF "FOR EXPERIENCE ONLY. 11 



Special Procedures 
and Matirials 



1} A special education student who receives the 
majority of instruction from a regular class- 
room teacher in an area measured by a stan- 
dardized test should take the test in that 
area * 

2) Most students receiving more than three (3) 
hours per day of special education services 
should be exempt from standardized testing, 

3) A student receiving three (3) hours or less 
per day of special education services who 
cannot be tested validly on a standardized 
test should be exempt* 

4) A special education student who cannot make a 
valid score on a standardized test may be 
tested if inclusion in the testing experience 
would be of benefit to that student in other 
ways , 



For those students who are to participate in stan- 
dardized testing, the ARD Committee is to determine 
which special administrative procedures arid special 
testing materials are necessary to ensure valid test 
results. The Backg round Inf ormation on A1SU 
Standardiz ed Te^UjOrind SpeciarTesETncTPr ocedur e^ 
for Standardize^ tests ( C) sections oFHJi isHiflmlou I 
were devil oped to provideARU Committee members with 
information relevant to making those decisions. 



Inclusion of Scores 
in Schools 1 Summary 
Reports 



Additional Copies 



ITB5/TAP: Test results for students in grades K-6 who 
receive one (1) hour or more per day of special 
education services are not included in the summary 
results reported for a school. Test results for 
students in grades 7-12 who receive more than three 
(3) hours per day of special education services are 
not included in summary reports, 

TEAMS " The scores of all special education students 
tested* except those whose booklets were marked DO NOT 
SCORE* are included in schools 1 TEAMS summary reports, 



If additional copies of these naterials are needed, 
please contact Rick Oattai le at ORE (450-1227) , 
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Attachment / 
(Page 1 of 3) 



AUSTIN INDEPENDENT SCHOGL DISTRICT 
Office of Research and Evaluation 




SPECIAL TESTING PROCEDUTIES FOR STANDARDIZED TESTS 



Q: 
A: 



\]\m SHOUUJ I ASK FOR SPECIAL TESTING PROCEDURES ON A STANDARDIZED 
TEST FOR A STUDENT AT MY SCHOOL? 



Special testing procedures should be requested when a student would 
otherwise not be able to obtain a valid store* on a regular teit 
administration. 



\lHAT TYPE OF SPECIAL PROCEDURES ARE AVAILABLE? 

Special procedures generally fall into two categories I 

2** Procedures which nay invalidate the use of tes_e norms * 

These usually provide an advantage over the normlng group (e.g., 
extending time limits) 9 or change the nature of the test (e.g., 
using a braille format) , or both (e*!*, reading a test to a 
student) , 

Scores mads with the uj# of the S3 sroQeebdreB may now be a^ult^d 
tohjard graduation aompeignay requirmerttB without the TZDroVal 
of thm SupevinEgndsnt * Requests for special testing procedures 
and the application of the resulting scores toward the graduation 
competency requirements are to be made by the students 1 ARD 
Committee, through ORE to the Superintendent * A form is attached 
for this purpose. 

2, Procedures which do . not invalidate the use_of test norms . 

These are not seen as affecting the nature or rigors of the 
standardized test, fome of these are using large^type editions, 
marking answers for a student, administering a test for a single 
student, revising the tast schedule, and signing the introduc- 
tion and directions. 
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Attachment 7 
(Page 2 of 3) 



Qi Who should hake a request for special testing procures for a 

STUDENT AT MY SCHOOL? 

Ai Requests for special testing procedures are to be sade by the ABB 
Committee Co Che buildinf administrator (usually a principal). 
The building administrator will contact the following for assistance 
in providing for these special needs* 



Contact 



Office of Research and Evaluation 



Type of Test 
Achievement 

Minimum Competency for 
Graduation 



Department of Secondary' Education 



a. Aptitude 

b , Vocational 



Q: Who will administer the tests using these special procedures? 

Regular school personnel should administer tests under special 
testing procedures whenever possible* In the event that school 
personnel cannot conduct these testings f Special Education will 
provide qualified testers. Any necessary training for these 
testers will be provided jointly by Special Education personnel 
and the Office of Research and Evaluation or the Department of 
Secondary Education* 
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Attachment 7 
(Page 3 of 3) 



AUSTIN INDEPENDENT SCHOOL DISTRICT 

REQUEST FOR SPECIAL ADMINISTRATION PROCEDURES 
Testing for HAnimum Competency for Graduation 

TO: Superintendent 

THROUGH: Director, Office of Research and Evaluation 
FROM: 



ARD Cocmlccam Representative 



School 



DATE: 



The ARB Committee for 



Student Nisa 



Student Number Current Grade 

requests that the foliowinf special ptocedure(s) be used In administering the scan^ 
dardi^ed tests for graduation competency , and chat the resulting scares be approved 
for application toward Che graduation competency requirements* 



Reading 



Math 



Special Procedures 
Braille 

Read Test to Student 
Extend Time Limits 
Other: 



Comments I 



I recommend that this request be 



Approved . 
Not Approved* 



Director's Signature Dati 



Comments \ 



This request is 



Approved , 
Not Approved* 



Superintendents Signature 



Date 



If you need additional copies of this farm, call ORE at 458^1227 or reproduce copies 
from this one* 
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AUSTIN INDEPENDENT SCHOOL DISTRICT 
Office of Research and Evaluation 



Attachment S 



May 19, 1983 



TO: 

FROM: 

SUBJECT: 



Itinerant Teacher for the Visually Handicapped 



David Wilkinson 



Change in Designated Testing Status for Students Administered Tes 
with Extended time 



As we discussed on May 12, a decision has been made In ORE to change the testing 
status of those special education students for whom an ARD Commit tee specified a 
test administration with extended time. This is to answer your question about, 
this decision more formally and to provide the documentation of this decision 
that you requested. 



Because, so far as we can ascertains 
administrations with special testing 
that scores such as percentiles and 
these no nns, may not be an accurate 
meut and may be liable to mislnterpr 
test administered under one of the s 
Category A on the Special Education 
extended time—needs to be taken for 
appropriate for these testing condit 
students was changed from valid to e 



Category A procedures, including ext 



the STEP and I TBS norms do not: include 
procedures, such as extended time, we feel 
grade equivalents, which are derived from 
and reliable estimate of a student's achieve- 
etation. Therefore, it was decided that any 
pecial testing procedures listed under 
scanning £ orm™Braiilp, read test, and 

experience only, since the norms are not 
ions* Accordingly, the testing status of 
xperience only for those tests for which 
ended time, were employed * 



A consequence of this change is that scores for redesignated tests, as with all 
experience-only scores, are not reported to the student or the campus, but are 
sent instead to the special education supervisor or coordinator assigned to the 
campus. This individual is requested by ORE to use discretion in sharing 
experience-only scores with other school personnel or with the student or the 
student -s parents. This request Is made for the reason stated earlier, that 
experience-only scores are not considered to be valid scores and may be misin- 
terpreted or misused, such as being given too much weight in course placement 
decisions , 

I hope this explanation is useful. If you have concerns about the decision or 
our procedures, I encourage you to express them to ^^^g^tes^^ so that we can 
discuss them with her when we meet next. If you have questions about individual 
students f scores, please call me and I will give them to you, or you may come 
to the ORE offices for them, 

DWlif 
ccr 



Approved ; 
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Director of Research and Evaluation 
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